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In the present study, we demonstrate how to perform, using quantum annealing, the singular 
value decomposition and the principal component analysis. Quantum annealing gives a way to 
find a ground state of a system, while the singular value decomposition requires the maximum 
eigenstate. The key idea is to transform the sign of the final Hamiltonian, and the maximum 
eigenstate is obtained by quantum annealing. Furthermore, the adiabatic time scale is obtained by 
the approximation focusing on the maximum eigenvalue. 


I. INTRODUCTION 

Quantum annealing [1-10] is a useful way to estimate 
the ground state of a system. Here and after we denote 
the target Hamiltonian as Hi. In the famous quantum 
annealing schemes [1-10], the time dependent Hamilto¬ 
nian H(t) is introduced as 

H(t) = (^1 - I) Ho + (1) 

using the initial system Hq. Here the characteristic time 
scale T is assumed to be long enough for the Schrddinger 
equation 

=^WIV'W) (2) 

to be regarded to describe the adiabatic process, namely 

= E(t)\^l)(t)), (3) 

where the eigenvalue E{t) corresponds to the energy of 

the total system ©■ Starting from such an initial con¬ 
dition as the ground state l^/’(0)) = Jc/io) of the initial 
system Ho, we can obtain the ground state of the sys¬ 
tem Hi at t = T. This is a simple outline of quantum 
annealing. 

Quantum annealing is often applied to estimate 
a ground state [10-16] in such complex systems as 
spin-glasses, and these studies are applied to non- 
deterministic polynomial (NP) problems such as the trav¬ 
eling salesman problem [11-14]. On the other hand, re¬ 
cently, information technology becomes more important 
and attention is paid to the statistical physics of infor¬ 
mation [17-19]. Especially, the scheme to treat the big 
data from aspects of statistical physics will develop in the 
near future. Actually, for example, Kurihara et al. stud¬ 
ied network clustering using quantum annealing [isl [l^ . 


* hashizume@rs.tus.ac.jp 
f nakajima@rs.tus.ac.jp 
f sokamura@rs.kagu.tus.ac.jp 
§ masuo.suzuki@riken.jp 


Thus, it may be important to analyze directly the big 
data from those kinds of viewpoints. 

In the case of data analysis, the principal component 
analysis is often used to find the trends shown in big 
data. Furthermore, the principal component analysis is 
equivalent to the singular value decomposition. Once 
we can perform the singular value decomposition using 
quantum annealing and clarify its mechanism, quantum 
annealing provides an efficient way of data analysis. 

Additionally, from the viewpoint of applications for 
fundamental problems of quantum physics, the singular 
value decomposition gives a useful way to study quan¬ 
tum states. For example, to find the entanglement be¬ 
tween subsystems Ha and Hb of the total Hamiltonian 
Htot = Ha-I-Ha, we have to obtain a reduced density ma¬ 
trix. To obtain the reduced density matrix, Schmidt de¬ 
composition and singular value decomposition are used. 
In other cases, to perform the density matrix renormal¬ 
ization group (DMRG) method, the singular value de¬ 
composition is necessary. Thus, it is also useful to show 
a possible way to perform the singular value decomposi¬ 
tion. 

In the present study, we show how to perform the sin¬ 
gular value decomposition using quantum annealing and 
we investigate the mechanism. In the next section, we 
make a brief introduction of the singular value decompo¬ 
sition from the viewpoint of an application of quantum 
annealing. In Sec. imi we introduce the key idea to per¬ 
form the singular value decomposition by quantum an¬ 
nealing, and demonstrate it explicitly by some informa¬ 
tion matrices. We analyze the mechanism of the present 
way by using approximated eigenvalue distributions and 
a series expansion, in Secs. llVI andIVl respectively. Sum¬ 
mary and discussions are included in Sec. ED 

II. SINGULAR VALUE DECOMPOSITION 

In this section, we make a brief introduction of the 
singular value decomposition. We consider an m x n 
matrix A for natural numbers m and n. The matrix G 
is defined as 


G = AU, 


( 4 ) 
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which is an n X n Hermitian matrix. The eigenvectors 
{kt)} 0 = and the eigenvalues {Aj} of the 

matrix G satisfy the equation 


G\vj) = Xj\vj). (5) 

Here the eigenvalues {A^} are real because G is Hermi¬ 
tian. In addition, using the inequality 

0<\\A\v,)r = {vM^A\v,) = X,, ( 6 ) 

it is easily found that the eigenvalue Xj is positive. 

If we define the vector \uj) as 

Wj) = -^A\vj), (7) 

the vector AA^Uj) is derived as 

AA^Uj) = -^AG\vj) = ^jA\vj) = Xj\uj). ( 8 ) 

Thus, the vector \uj) is an eigenvector of the matrix AA'^ 
with the eigenvalue Xj including m components. 

Using the vectors {!%)}, and the eigenvalues 

{Ajj, the matrix A is decomposed as 


j 3 


This decomposition is so called “singular value decompo¬ 
sition” , and the weights {^/^} are called “singular val¬ 
ues”. To use the singular value decomposition for data 
analysis, the component with larger singular values are 
more important. Thus, we put the eigenvalues {Aj} in 
order as Aq > Ai > A 2 > .... In this case, |uo) is called 
“first principal component”, |r!i) is called “second prin¬ 
cipal component”, and so on. This is nothing but the 
principal component analysis [^ . In many cases, even 
though it is not necessary, the data matrix A = (atj) is 
often normalized so as to satisfy the relations 

^ m 
k=l 


III. DEMONSTRATION OF SINGULAR VALUE 
DECOMPOSITION BY QUANTUM ANNEALING 


To perform the singular value decomposition, we need 
to obtain the largest eigenvalue of the matrix G = A"^ A 
for the information matrix A. However, the quantum 
annealing method yields the ground state of the target 
Hamiltonian T-Li. Then, we put the target Hamiltonian 
'Hi as — G, namely 

Hi=-G = -AtA (12) 

Thus, the total Hamiltonian H(t) is defined as 

= (13) 


using Eq. O- Generally, the matrix G often includes 
the non-zero off-diagonal elements which play the role 
of quantum effects of the Schrodinger equation 


= 'H(t)IV'W) 




1 - y 1 ^0 


m))- (14) 


The initial Hamiltonian Ho to treat the present problem 
is defined as the diagonal matrix 


Hq = — (Ao -I- A) |(()o)(0o| + A 

/-Ao 0 0 ••• 

0 A 0 ••• 

0 0 A ••• 

V ••• 


(15) 


with some positive parameters Aq and A. Using the bases 
((^o| = (1,0,0,...), ((^i| = (0,1,0,...) and so on, the 
initial Hamiltonian Hq yields the ground state |0o) with 
the eigenvalue — Aq, and the degenerated exited states 
• with the same eigenvalue A. The initial 
state |'0(O)) is assumed as the ground state namely 


and 

^ m 

= (“U - ajf = 1- (11) 

k=l 

When the data matrix A is normalized, the matrix 
G = A^ A corresponds to the variance-covariance matrix. 
Then, the principal component analysis corresponds to 
the eigenvalue analysis of the variance-covariance matri¬ 
ces. 

As shown in Eq.Q, the singular value decomposition 
and the principal component analysis require the eigen¬ 
state with larger eigenvalues, because the larger singular 
values strongly contribute to the original data matrix A 
with the weights ^/X^j■ Thus, for the data analysis, it 
is enough to find the first- and second-principal compo¬ 
nents. In the present study, we try to find the first- 
principal component |no) (whose eigenvalue is the largest 
one), using quantum annealing. 


1^(0)) = \M- (16) 

The time development of the state vector |'0(t)) is ob¬ 
tained by 

|'0(t -b dt)) = \ijj{t)) + -^H{t)\tp{t))dt (17) 

in 

from the Schrodinger equation m- Finally, if quan¬ 
tum annealing works well, we can expect that the first- 
principal component |no) is obtained as = j'Co) at 

the time t = T. 

In this section, on the basis of the above assumption, 
we demonstrate two examples, namely, a small data ma¬ 
trix and an image data matrix. Especially, recent stud¬ 
ies clarified the importance of the image analysis using 
the singular value decomposition from the viewpoint of 
critical phenomena. The present demonstrations may be 
interesting from such a point of view. 
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A. Singular value decomposition of 
two-dimensional data 


and the state vector |^/’(T)) is also obtained from Eg. lfTTl) 
as 


In the present section, we show a simple example to 
demonstrate the singular value decomposition of a small 
matrix using quantum annealing. We consider a league 
table showing the records of two persons (students) and 
their three exams as a normalized form. Such an infor¬ 
mation matrix is denoted as 


A = 


ail 

ai2\ 

/ -0.69 

-0.68 

021 

022 = 

-0.023 

0.73 

031 

032/ 

V 0.72 

-0.043 


(18) 


where the parameters {oy } are normalized to satisfy the 
relations and (HU. The variance-covariance matrix 
G is obtained as 

« = = (o.« "f) ■ (“) 

In the present case, the eigenvalues Aq and Ai (Aq > Ai), 
and the eigenvectors |uo) and |ui) are easily obtained as 

Ao = 1.43 and Ai = 0.57, (20) 


and 


I””* = (!) = 71 (-i)' 

respectively. We try to obtain the above first-principal 
component jup) using quantum annealing. 

To perform the quantum annealing, the initial Hamil¬ 
tonian 7io and its ground state |(/)o) are defined as 

no = and |</>o) = Q (22) 


by Eq. ((I5]), where we assume Ap = A = 1. Thus, the 
time dependent Hamiltonian n{t) is expressed as 


n{t) = -- 


1 0.43 

0.43 1 


e + 




(23) 


where the parameter e denotes an “energy constant” in¬ 
troduced to clarify the unit of the energy. Assuming the 
large time scale T, the Shrddinger equation can be ap¬ 
proximated as 

*^^IV'(i)) = n{t)\tljit)) ~ E{t)\tljit)), (24) 

as discussed in Sec. HI The ground state energy E{t) is 
obtained as 

E{t) = 0.5\/4.74t2 - srt -h 4r2) 

-^ -1.43e, (25) 

t^T 



where we have assumed T = IQ^Ti/e. The state \il){T)) is 
nothing but the first-principal component jup) which is 
the eigenstate of G with the largest eigenvalue Ap = 1.43. 
As shown in the present demonstration, we can perform 
the singular value decomposition by quantum annealing 
using the Hamiltonian (fT51) . To obtain the second largest 
eigenstate, namely the second-principal component, we 
rewrite Eq. as 


A = •\/a)(|mo)(up| -I- a/AiI'“i)(^iI 4- 

A - V%'|mo)(i'o| = \Ai|wi)(^^i| H-• (27) 

As shown in Eq. (EU, under the redefinition of the infor¬ 
mation matrix A as A —i A — •\/^|mo)(wp|, we can find 
the second-principal component |ui) as the first-principal 
component. Then, we obtain the arbitrary spectrum of 
the singular value decomposition in a step-by-step man¬ 
ner. 

As shown in this demonstration, our algorithm offers 
no guarantee of speeding up over a classical algorithm 
even for determining one principal component. Deter¬ 
mining all others one by one is as classical as it could 
be. 


B. Image analysis by quantum annealing 



FIG. 1. (Color online) The logo of Tokyo University of Science 
(left-hand side). The binary image of the logo of TUS (right- 
hand side) is regarded as the information matrix A. 

Recently, Matsueda et al. proposed a new idea of the 
way to image analysis based on the singular value de¬ 
composition [21-25]. These previous studies suggested 
that the singular values decay in a power law or ex¬ 
ponentially reflecting the correlation scales shown in the 
image [21-23]. In the present section, we try to perform 
the singular value decomposition of an image by quantum 
annealing. 

The original test image is the logo of Tokyo University 
of Science (TUS) as shown in EigjlJ Clearly, we can find 
highly symmetric and several scales are included in this 
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FIG. 2. (Color online) Singular value decomposition of the 
logo of TUS given by the quantum annealing method. All 
figures show decomposed 1328 x 1324 matrices. The left-hand 
sides show each component \uj){vj\ while the right-hand sides 
show the summation \/YWj){'>^j\- 


figure. Here we use the binary (1,-1) data of the logo, 

I 


and obtain the 1328 x 1324 matrix A. Using the present 
scheme as discussed in the previous sections, we obtain 
the decomposed image as shown in Fig. [2j The left-hand 
sides of Fig. [5] show each component while the 

right-hand sides show the summation Y Wj){vj\. As 
shown in Fig. [2l the singular value decomposition splits 
the data matrix into layers characterized by correlation 
scales as was pointed out in the previous studies [24,25] 
by Matsueda et al. In the present case, we also find 
that quantum annealing works well enough to perform 
the singular value decomposition of the image data. 


IV. ANALYTICAL EXPLANATION OF THE 
PRESENT METHOD 

In the present section, we study the mechanism of the 
present method to perform the singular value decomposi¬ 
tion by quantum annealing. The time-dependent Hamil¬ 
tonian 'H[t) is denoted as 

n{t) = n{x) = -xG + {i-x)nQ, (28) 

where the parameter x denotes x = t/T. Assuming the 
adiabatic process with large T, the Schrodinger equation 
(fill) yields the equation 

n{x)\tfj{x)) = E{x)\ij{x)) (29) 

using the eigenvalue E{x). The initial condition of \‘il){x)) 
is assumed as |^/’(0)) = |(?io) which is the ground state 
of the initial Hamiltonian m- We assume the simple 
case Ao = A in the initial Hamiltonian (flSl) . The target 
matrix G satisfies the equation 


G\vj) = Xj\vj), (30) 

for all principal components {juj)}, where the eigenvalues 
{Aj} are put in order as 


Ao>Ai>--->0. (31) 

As shown in the previous studies [21-25], the largest 
eigenvalue Ao is much larger than the second largest one 
Al. Thus, we assume here the approximation Ai/Aq — 0. 
In this prediction, the state vector \ip{x)) is approxi¬ 
mately expressed as 

\'ip{x)) ~ a{x)\vo) + b{x)\(l)o) (32) 

using the functions a(x) and b(x) as the coefficients. 
Then, Eq. (1^ yields 


[-xG + (1 - x)'Hq\ [a(x)l-yo) + b{x)\(l)o)] = E{x) [a(x)l-uo) + b{x)\(j)o)] 
I [—Aox + (1 — a:)Ao] a(x) — XQx{vo\4>o)b{x) = E{x)a{x) 

I -2Ao(l - a;)(i;o|</>o)a(a;) + [-(1 - a;)Ao] b{x) = E{x)b{x). 


(33) 
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Therefore, the energy E{x) is obtained as 


E{x) 


-xK ± 4(1 _ ^-^2 43.(1 _ a;)(2Q,2 - 1)K , 


(34) 


where the parameters K and a are defined as K = Xq /Aq 
and a = (no|<(>o) = (<('oko); respectively. As shown in Eq. 
(IMl) . the initial eigenvalues ±Ao are expressed as E{0) = 
±Ao, while the final eigenvalnes £'(1) become —Aq and 
0. One of the final eigenvalues, £(1) = 0, should be 
£(1) = — Ai rigorously. This is due to the approximation 
Ai/Ao — 0 . 

We show the x dependence of E{x), a{x), and b{x) in 
Figs. [3]and|H Both of the numerical calculations shown 
in these figures, the parameters K and a are assumed as 
K = a = 0.5. Figure 13] shows the energy profiles through 
the quantum annealing process. The energy gap AE(x) 
has the minimum value 


I £^q;^( 1 — cr^) 

(35) 

As is well known [ 2 ^, the appropriate time scale T sat¬ 
isfies the relation 

^ Ao?i 1 

min[A£(x)] Aoa^{l-a^) 

Then, the time scale T diverges when the parameter 
a = (^ol'i’o) vanishes, that is, the final state |uo) can¬ 
not be obtained when the initial condition is orthogonal 
to the final sate \(j)o). In addition, from Eq. (|36)l . the 
condition a = 1 also yields the divergence of the time 
scale T. However, in such a case, it is not necessary to 
perform quantum annealing because |(()o) = |uo)- Figure 
m shows the functions a{x) and h{x) defined in Eq. (1321) . 
The initial condition |'(/’(0)) = |0o) yields the conditions 
a(0) = 0 and 6(0) = 1 . As shown in FiglU the state vec¬ 
tor \tj}{t)) monotonically changes from the ground state 
|(()o) of the initial Hamiltonian to the first-principal com¬ 
ponent juo) of the information matrix A. 


V. POWER SERIES OF EIGENVECTORS 

It is interesting to note the power series of eigenvalues 
of the present way. We expand the state vector \tj}{t)) as 

00 / ,\n 

i^w) = E t) 

n =0 A A 

using the set of vectors {!/«)} which are time- 
independent. Here the vectors {\ fn )} are not necessarily 
orthogonal. Thus, using Eqs. (11^ . (fTH) . and (1371) . we 
obtain the relations 

1/0) = 1/1) = ^'Hol/o), (38) 



FIG. 3. (Color online) Eigenvalue properties of the ground 
state and the excited state. The parameters K and a are 
assumed as K = a = 0.5. AE{x) denotes the energy gap. 
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FIG. 4. (Color online) The functions a{x) and b{x). 


and 

l/n) = [Holfn-l) - {G + 'Ho)\fn-2)] i {n > 2 ), 

(39) 

for the initial condition \4’{0)) = |(^o)- Then, at time 
t = T, we obtain the final state \tfj{T)) as 

OO 

mn = E I/-)- (40) 

n —0 

Unfortunately, we cannot find the general expressions of 
\fn)- However, the present expression shows the mixture 
of states as 

OO 

\i;{o)) = \M^mT)) = j2\fn). ( 41 ) 

n —0 

This result may be interesting from the viewpoints of 
entanglements. Especially, the recurrence formula shown 
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in Eqs. (l38)) and ((3^ is time-independent. Thus, it is 
useful for such numerical calculations as image analyses 
shown in Fig. [21 

VI. SUMMARY AND DISCUSSIONS 

In the present study, we demonstrate the possibility to 
perform the singular value decomposition using the quan¬ 
tum annealing method. The key idea is to transform the 
sign of the final Hamiltonian as shown in Eq. (1121) . Fur¬ 
thermore, we have investigated the physical background 
of the present application, namely, the eigenvalue profile 
and the rigorous expansions. Finally, we have obtained 
the applicable time-scale estimated by the energy gap 
shown in Eq. dSSl). 

The present study suggests an important application 
of quantum annealing to big data analysis. Especially, 
the principal component analysis is important to analyze 
big data with projecting the data onto lower (at most 
one- or two-)dimensional data. The present method will 
be useful for such statistical physics of information as 
analyzing big data. 

Through this study, we just show a possible way of the 
singular value decomposition using quantum annealing. 
The present discussion is based on the scheme of tradi¬ 
tional theory of singular value decomposition (as shown 
in Sec. ID, and then, our use of quantum annealing does 


not provide a new kind of matrix decomposition. How¬ 
ever, we expect that the present method will provide new 
aspects both of singular value decomposition and quan¬ 
tum annealing. Further studies on the application for 
quantum physics such as quantum entanglement will pro¬ 
pose a new kind of application of quantum annealing. 

Finally, we mention the relations between the initial 
Hamiltonians of typical quantum annealing and that of 
the present method. In typical quantum annealing, it 
focuses on the ground state of classical complex sys¬ 
tems such as spin-glasses. Then, quantum effects 

are included in the off-diagonal elements of the initial 
Hamiltonian On the other hand, in the present 

method, the target Hamiltonian matrix 'Hq = ~G is, gen¬ 
erally, not diagonal, because the matrix G = A^A corre¬ 
sponds to the variance-covariance matrix. Thus, even if 
the initial Hamiltonian is defined by such a diagonal ma¬ 
trix as shown in Ea. dTSl) . the state vector \tp{t)) changes 
toward to the ground state of — G. 
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